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music game 



(57) A game system that allows a player to freely 
form score data of performance procedures, thereby 
providing the player with more fun and a greater feeling 
of satisfaction. In the game system, music data for re- 
playing music and score data defining contents of play 
to be played in time to the music are used. The game 
system comprises a main memory memorizing both the 
music data and the score data, a controller receiving op- 



erations done by the player, a loudspeaker for replaying 
the music using the music data, a monitor for instructing, 
based on the score data, the player to do performance 
operations associated with the music replay to the con- 
troller 52, and the controller through which the score da- 
ta are input according to the player's operations. The 
controller operates to store the score data into the main 
memory. 



< 

N 
<* 
00 

CO 

o> 
o> 

o 

Q_ 

111 



PrintadbyJouve, 75001 PARIS (FR) 



1 



EP 0 993 847 A1 



2 



Description 

[0001] The present invention relates to a game sys- 
tem having a configuration that enables a player to enjoy 
performing operations to music. 
[0002] At present, gams systems are commercially 
available, which provide players with fun derived from 
directing music by mixing sound effects with music 
played as BGM (Back Ground Music), as seen in DJ 
(Disc Jockey), or adding an ad-lib performance to music. 
For example, a product "Hiphop Mania" produced by 
Konami Co. Ltd. is one such typical example. Direction, 
rendering, or performance that are to be mixed with 
BGM are previously memorized as score data. Thus, 
how faithfully a player performs operations with follow- 
ing the score data is evaluated and the evaluation is re- 
flected in the result of games. 
[0003] However, the conventional game systems 
have not the configuration which makes players input 
new score data or delete some score data. Namely play- 
ers are not allowed to produce score data at their own 
free will. 

[0004] An object of the present invention is to provide 
a game system that enables a player to freely produce 
score data defining performance procedures and make 
the player enjoy the game more actively. 
[0005] According to one aspect of the present inven- 
tion, there is provided a game system comprising: a data 
storage device for respectively memorizing data for re- 
playing music and data defining performance proce- 
dures for the music; a performance operating device for 
receiving performance operations of a player; a music 
replaying device for replaying the music based on the 
data for replaying the music; a performance operation 
instructing device for instructing the player to do per- 
formance operations associated with the replay of the 
music to the performance operating device based on the 
data defining the performance procedures; a perform- 
ance effect generating device for generating perform- 
ance effects corresponding to the performance opera- 
tions to the performance operating device; and a data 
inputting device for inputting or deleting at least part of 
the data defining the performance procedures in re- 
sponse to operations of the player, wherein the data 
formed through the data inputting device are stored into 
the data storage device and the performance operation 
instructing device can instruct the player to do predeter- 
mined performance operations based on the data input 
through the data inputting device. 
[0006] Since there is provided the data inputting de- 
vice for inputting or deleting at least part of the data de- 
fining the performance procedures in response to oper- 
ations of the player, and the performance operation in- 
structing device can instruct the player to do predeter- 
mined performance operations based on data input 
through the data inputting device, the player can freely 
form the data defining the performance, rendering or 
rendering procedures, and can enjoy the game more ac- 



tively. 

[0007] The game system may further comprise a de- 
vice for storing a plurality of types of sound effects to be 
generated as the performance effects. 
5 [0008] Since it is possible to use a plurality of types 
of sound effects stored in the device, the performance 
effect can be enhanced. 

[0009] In the game system, one type of the sound ef- 
fects to be generated as the performance effects may 

w be selected in accordance with an operation of the play- 
er, when the data defining the performance procedures 
are input through the data inputting device. 
[0010] Since the type of effect sounds is selected ac- 
cording to the will of the player, the player can enjoy the 

is game more deeply. 

[0011] In the game system, a selected sound effect 
may be replayed when said one type of the sound ef- 
fects is selected in accordance with the operation of the 
player. 

20 [001 2] The replay performed when the type of sound 
effects has been selected enables the player to confirm 
the sound effects actually. 

[001 3] The game system may further comprise an in- 
dicating device for showing a position residing in the mu- 
25 sic to be subjected to input or deletion of the data : when 
the data defining the performance procedures are input 
or deleted in a piece of the music by the player through 
the data inputting device. 

[001 4] Since a position to be objective for the input or 
30 deletion of the data is instructed by the instructing de- 
vice, the input of the data and others can be done stead- 
ily. 

[0015] The game system may further comprise a re- 
playing device for replaying the sound effects based on 

35 the data defining the performance procedures when the 
data defining the performance procedures are input or 
deleted through the data inputting device. 
[001 6] In this case, the sound effects according to the 
data that define performance procedures are replayed 

40 by the replaying device : resulting in that the player can 
confirm the performance effects derived based on the 
data formed by him or herself. 
[0017] In the above game system, the replaying de- 
vice may replay a series of the sound effects to be used 

45 as the performance effects after completing the opera- 
tions of the player to input or delete the data defining 
the performance procedures. The replaying device may 
replay the sound effects with mixing the music. 
[0018] Based on the above configurations, the sound 

so effects are replayed with being mixed with a piece of the 
music, so that the player can surely confirm the sound 
effects. 

[0019] The game system may further comprise a 
range setting device for setting, in accordance with an 
55 operation of the player, a range of the sound effects to 
be replayed through the replaying device to an extent 
corresponding to at least part of a piece of the music. 
Thus, the sound effects can be replayed within only in 
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the range that the player desires. 
[0020] In the above game system, the data inputting 
device may be constructed such that the data are input 
by making the player repeat operations of assigning the 
respective sound effects corresponding to each of the 
performance operations composing the performance 
procedures, and the replaying device can replay each 
of the input sound effects every time the player assigns 
the sound effects to each of the performance opera- 
tions. 

[0021] Thus, whenever the sound effects are input re- 
sponsively to each performance operation, the player 
can confirm the input sound effects. 
[0022] In the above game system, the data storage 
device may memorize data defining a plurality of sets of 
the performance procedures for one piece of the music. 
Thus it is possible for the player to enjoy a plurality of 
types of performance operations concerning each piece 
of the music. 

[0023] In the above game system, the data memo- 
rized in the data storage device and defining the per- 
formance procedures corresponding to a specific piece 
of the music may be all input through the data inputting 
device. 

[0024] In the above game system, the performance 
operating device may be used as the data inputting de- 
vice and the performance operations instructed through 
the performance operation instructing device may be 
the same as player's operations performed in inputting 
the data defining the performance procedures. 
[0025] Therefore, the same operations as perform- 
ance operations make it possible to input the data. In 
consequence, the procedures for inputting the data can 
be simplified. 

[0026] The game system may further comprising; an 
input-position pointing device for indicating a position in 
a piece of the music at which the data are input or de- 
leted, when the player inputs or deletes the data defining 
the performance procedures corresponding to the piece 
of the music through the data inputting device; and an 
indicator having at least one track extending in a spec- 
ified direction, wherein the performance operation in- 
structing device displays, based on the data defining the 
performance procedures, an indication mark to indicate 
operation timing of the performance operating device 
within the indicator in such a manner that the indication 
mark moves along the track and then reaches a per- 
formance operation position fixedly set at a specified lo- 
cation of the track when the operation timing of the per- 
formance operating device corresponding to the indica- 
tion mark comes, and the input-position pointing device 
displays, within the indicator, a pointing mark to show a 
position existing in the music at which the data are input 
or deleted in such a manner that the pointing mark 
moves along the track and is located at an input-opera- 
tion position fixedly set at a specified location of the track 
when the data inputting device is operated correspond- 
ingly to the pointing mark. 



[0027] Because the pointing mark is located at an in- 
put-operation position fixedly set at a specified location 
of the track, when the data inputting device is operated 
correspondingly to the pointing mark, the player can 
5 surely input the data and perform other operations. 
[0028] According to another aspect of the present in- 
vention, there is provided a game system comprising: a 
data storage device for respectively memorizing data for 
replaying music and data defining performance proce- 
dures for the music; a performance operating device for 
receiving performance operations of a player; a music 
replaying device for replaying the music based on the 
data for replaying the music; a performance operation 
instructing device for instructing the player to do per- 
formance operations associated with the replay of the 
music to the performance operating device based on the 
data defining the performance procedures; a perform- 
ance effect generating device for generating perform- 
ance effects corresponding to the performance opera- 
tions to the performance operating device; and a data 
editing device for editing data defining the performance 
procedures memorized in the data storage device in re- 
sponse to operations of the player, wherein the perform- 
ance operation instructing device can instruct predeter- 
mined performance operations based on the data edited 
through the data editing device. 
[0029] Since the above game system comprises the 
data editing device for editing the data defining the per- 
formance procedures in accordance with operations of 
the player, and the performance operation instructing 
device can instruct predetermined performance opera- 
tions based on the data edited through the data editing 
device, the player can freely form the data and have a 
greater feeling of satisfaction in the game. 
[0030] According to still another aspect of the present 
invention, there is provided a game system comprising; 
a data storage device for respectively memorizing data 
for replaying music and data defining performance pro- 
cedures for the music; a performance operating device 
for receiving performance operations of a player: a mu- 
sic replaying device for replaying the music based on 
the data for replaying the music; a performance opera- 
tion instructing device for instructing the player to do per- 
formance operations associated with the replay of the 
music to the performance operating device based on the 
data defining the performance procedures; a perform- 
ance effect generating device for generating perform- 
ance effects according to the performance operations 
to the performance operating device; and a data forming 
device for newly forming data defining the performance 
procedures according to operations of the player, 
wherein the data storage device memorizes the data 
newly formed and the performance operation instructing 
device can instruct the player to do predetermined per- 
formance operations based on the data newly formed 
through the data forming device. 
[0031] In this embodiment, the system comprises the 
data forming device for newly forming the data defining 



15 



20 



25 



30 



35 



40 



45 



50 



3 



5 



EP 0 993 847 A1 



6 



the performance procedures in response to operations 
of the player and the performance operation instructing 
device can instruct the player to do predetermined per- 
formance operations based on the data newly formed 
through the data forming device. Therefore, the player 
can freely form the data and enjoy the game with an ex- 
citing feeling. 

[0032] According to still another aspect of the present 
invention, there is provided a computer-readable stor- 
age medium storing data for replaying music, data de- 
fining performance procedures for the music, and a pro- 
gram for performing a predetermined music performing 
game based on both of the data, the program being 
formed to allow a computer to perform the following 
steps of: replaying the music based on the data for re- 
playing the music; instructing a player to do perform- 
ance operations associated with the replay of the music 
to a performance operating device based on the data 
defining the performance procedures for the music; gen- 
erating performance effects corresponding to the per- 
formance operations to the performance operating de- 
vice; inputting or deleting at least part of the data defin- 
ing the performance procedures and memorizing an in- 
put or deleted result data in response to operations of 
the player: and pointing predetermined performance op- 
erations to the player based on the memorized data. 
[0033] Accordingly, predetermined performance op- 
erations can be taught the player based on the data in- 
put responsively to player's operations, resulting in that 
the player can freely form the data and have an active 
attitude in pursuing fan at the game. 
[0034] According to still another aspect of the present 
invention, there is provided a computer-readable stor- 
age medium storing data for replaying music, data de- 
fining performance procedures for the music, and a pro- 
gram for performing a predetermined music perform- 
ance game based on both of the data, the program being 
formed to allow a computer to perform the following 
steps of: replaying the music based on the data for re- 
playing music; instructing a player to do performance 
operations associated with the replay of the music to a 
performance operating device based on the data defin- 
ing performance procedures; generating performance 
effects corresponding to the performance operations to 
the performance operating device; editing the data de- 
fining performance procedures in accordance with op- 
erations of the player; and instructing predetermined 
performance operations based on the edited data. 
[0035] In this embodiment, it is possible to teach the 
player predetermined performance operations based on 
the data edited in response to player's operations. This 
allows the player to form the data by him or herself and 
to have more fun at the game. 
[0036] According to still another aspect of the present 
invention, there is provided a computer-readable stor- 
age medium storing data for replaying music, data de- 
fining performance procedures for the music, and a pro- 
gram for performing a predetermined music perform- 



ance game based on both of the data, the program being 
formed to allow a computer to perform the following 
steps of: replaying the music based on the data for re- 
playing the music; instructing a player to do perform- 

5 ance operations associated with the replay of the music 
to a performance operating device based on the data 
defining the performance procedures; generating per- 
formance effects corresponding to the performance op- 
erations to the performance operating device; newly 

10 forming the data defining the performance procedures 
in response to operations of the player; memorizing the 
newly formed data; and instructing the player to do pre- 
determined performance operations based on the mem- 
orized data. 

is [0037] As described above, it is possible to give the 
player instructions about predetermined performance 
operations based on the data newly formed in response 
to player's operations, thereby allowing the player to 
freely form the data and enjoy the game more satisfac- 

20 torily. 

[0038] To facilitate the understanding of the present 
invention, typical references shown in the accompany- 
ing drawing have been attached with the parentheses 
to the main constituents of the present invention as 
25 above. However the present invention is, of course, not 
to confined to the modes shown in the embodiments. 

In the accompanying drawings: 



30 [0039] 

Fig. 1 is a block diagram showing an embodiment 
into which the present invention is practiced as a 
home-use game machine; 

35 Fig. 2 explains the relationship between BGM data 
recorded in the CD-ROM in Fig.1 and score data 
recorded in association with the BGM data; 
Fig. 3 shows a fundamental game picture for a mu- 
sic-directing game executed by the game system 

40 shown in Fig. 1; 

Fig.4 is an enlarged view showing an indicator dis- 
played at each end of the game picture; 
Fig. 5 is a flowchart showing a main routine execut- 
ed by the game system of Fig. 1 ; 

45 Fig. 6 is a diagram showing one example of a table 
defining the relationship between operations to a 
controller and sound effects to be generated in re- 
sponse to the operations in the game system of Fig. 
1; 

so Fig. 7 is an explanation showing a display picture on 

a monitor in inputting score data; 

Fig. 8 is a flowchart representing a main routine of 

the processing when in an edit mode; 

Fig. 9 shows a flowchart of BGM selection process - 
55 ing; 

Fig. 10 is an explanation indicating another display 
picture on the monitor when in the BGM selection 
processing; 
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Fig. 11 is a flowchart showing score-data new-form- 
ing processing; 

Fig. 1 2 is a flowchart showing sound effect selection 
processing; 

Fig. 13 is a flowchart showing data preservation s 
processing; 

Fig. 14 is a flowchart showing score-dala editing 
processing; 

Fig. 1 5 is a flowchart showing score-data new-form- 
ing processing in a second embodiment of the 
present invention; 

Fig. 16 is a view showing a configuration of a dedi- 
cated controller; 

Fig. 17 is a display picture on the monitor when in 
the BGM selection in cases the controller of Fig. 16 
is used; and 

Fig. 18 is a display picture on the monitor when in 
inputting score data in cases the controller of Fig. 
16 is used. 

(First Embodiment) 

[0040] Fig. 1 shows a first embodiment into which a 
home-use game system according to the present inven- 
tion is practiced. The configuration shown in Fig.1 is 
based on a general configuration adopted in a typical 
home-use computer game system which is disclosed in 
detail by Japanese Patent Unexamined Publication 
8-212377, for example. 

[0041] The game system 1 shown in Fig.1 is provided 
with a main control part 10, graphic control part 20, 
sound control part 30, disk reading part 40, and com- 
munication control part 50, where the parts 10 to 50 are 
mutually connected via a main bus B. The main control 
part 10 comprises a CPU 11 main constructed by a mi- 
croprocessor for executing calculations necessary for 
advancing a game and for controlling each part of the 
system, a peripheral device 12 for interrupt control to 
the CPU 11 and auxiliary control such as access to 
memories, a main memory 13 composed of semicon- 
ductor memory elements such as relodable RAM and 
others, and a ROM which memorizes programs for con- 
trolling the basic operations of the game system 1 . 
[0042] The graphic control part 20 comprises a geom- 
etry transfer engine (GTE) 2 1 , serving as a coprocessor, 
for executing specific calculation necessary for image 
rendering in response to commands from the CPU, for 
example, the calculation of coordinates of polygons 
used to express three-dimensional images and other; a 
graphics processing unit (GPU) 22 executing specific 
rendering processing in response to rendering com- 
mands issued from the CPU 1 1 ; a frame buffer 23 func- 
tioning as temporary memory means for data rendered 
by the GPU 22; and an image decoder (MDEC) 24 de- 
coding compressed data of images which has been 
stored in the main memory 13. Under progress of a 
game, image data which have been recorded in a CD- 
ROM 44 as a storage medium are loaded into the main 



memory 13 as is needed, and decoded by the MDEC 
24, and rendered into the frame buffer 23 by the GPU 
22. Any region in image frames rendered in the frame 
buffer 23 is displayed on a monitor 25 serving as display 
means, which is the CRT of a home-use TV set, for ex- 
ample. 

[0043] The sound control part 30 has a sound produc- 
tion processing processor (SPU) 31 for generating mu- 
sic sounds, sound effects and others based on com- 
mands provided by the CPU 11; a sound buffer 32, hav- 
ing a memory capacity of 512 kilobytes, for example, 
into which data of audio, music sounds and others and 
data of sound sources, those data being read from the 
CD-ROM 44; and a speaker 33 serving as sound output 
means outputting music sounds, sound effects and oth- 
ers generated by the SPU 31 . 

[0044] The SPU 31 has an ADPCM encoding function 
by which audio data which have undergone an adaptive 
differential encoding (ADPCM) process are reproduced, 
in which 16-bit audio data are handled as 4-bit differen- 
tial signals; a replaying function for generating sound 
effects and others by replaying data of sound sources 
stored in the sound buffer 32; a modulating function for 
modulating audio data to be replayed and x others mem- 
orized in the sound buffer 32: and other necessary func- 
tions. That is, the SPU 31 possesses functions for au- 
tomatic conversion of operation parameters including 
coefficients of looping and time, incorporates therein an 
ADPCE sound source having a capability of 24 voices, 
and operates responsively to operations provided from 
the CPU 11. Furthermore, the SPU 31 administers an 
inherent address space mapped in the sound buffer 32 
to transfer ADPCM data into the sound buffer 32. Ac- 
cordingly, the data are replayed with information about 
both ■off or °on u of keys, and modulation passed directly 
to the sound buffer. 

[0045] These functions make it possible that the 
sound control part 30 is used as a source, called sam- 
pling sound source, which generates music sounds, 
sound effects and others using audio data stored in the 
sound buffer 32, in response to commands from the 
CPU 11. 

[0046] The disk reading part 40 is provided with a disk 
drive 41 replaying programs, data and others stored in 
the CD-ROM 44, a decoder 42 decoding programs, data 
and others stored with error correction code (ECC) ; and 
a buffer 43, having a memory capacity of 32 kilobytes, 
for example, temporarily storing data replayed by the 
disk driver 41 . In other words, the disk reading part 40 
is configured by components required for reading data 
from disks, which includes the disk drive 41 , decoder 42 
and the like. In this embodiment, disk formats are pre- 
pared to support data formatted into, for example, CD- 
DA and CD-ROM XA. In addition, the decoder 42 func- 
tions part of the sound control part 30. 
[0047] Audio data stored in disks, which are to be re- 
played by the disk drive 41 , include data referred to as 
PCM data formed by analog-to-digital converting audio 
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signals, in addition lo the foregoing ADPCM data (such 
as ADPCM data for CD-ROM XA and others). As AD- 
PCM data, audio data are used which are, for example, 
recorded with differentials of 16-bit digital data ex- 
pressed by four bits. Such audio data are subject to error 
correction and decoding in the decoder 42, before being 
sent to the SPU 31 where they undergo processing such 
as digital-to-analog conversion. The processed data are 
then used for driving the speaker 33. As PCM data, au- 
dio data are recorded in the form of, for example. 16-bit 
digital data. Such audio data are decoded in the decoder 
42, and used to drive the speaker 33. Audio outp uts from 
the decoder 42 are temporarily sent to SPU 31 where 
the audio outputs are mixed with the SPU outputs, and 
provided as the final audio outputs through a reverb unit. 
[0048] The communication control part 50 has a com- 
munication control device 51 controlling communication 
carried out toward the CPU 11 using the main bus B; a 
controller 52 which is used as operation input means 
and which has a plurality of operating members (for ex- 
ample, push button switches) operated by a player; and 
a memory card 53 (auxiliary storage medium) whose 
main constituents are reloadable and loadable semicon- 
ductor elements. In the controller 52, there are provided 
a performance operating portion 52a used for instructing 
the right, left, up, and down directions, and selection op- 
erating portions 52b and 52c composed of a plurality of 
push button switches, respectively A variety of func- 
tions are assigned to operated members of each of the 
operating portion 52a to 52c according to conditions in 
the progress and setting of a game. Signals indicative 
of operated conditions for the operating members are 
outputted from the controller 52 at given periods (for ex- 
ample, 60 times per second). The outputted signals are 
sent to the CPU 1 1 via the communication control device 
51. In Fig. 1 , although only a single set of controller 52 
and memory card 53 have been expressed, a plurality 
of sets of controller 52 and memory card 53 can be ar- 
ranged as the communication control device 51. 
[0049] Furthermore, the game system 1 has a parallel 
I/O (input/output) port 6 1 and a serial I/O port 62 to which 
peripheral devices are connected. Other game systems 
are possible to be connected with the serial I/O port 62 
through communication cables not shown, thereby mak- 
ing it possible to perform a common game between two 
game systems with data communicated therebetween. 
[0050] When the CD-ROM 44, which has recorded 
therein programs and data required for performing 
games according to the present invention, has been set 
into the disk reading part 40, and an initializing operation 
(for example, the power "on", a not -shown reset switch 
"on") has been carried out, the CPU 11 starts to perform 
a specified music play game in accordance with pro- 
grams stored in the CD-ROM 44. Those music play 
games are outlined such that data of BGM which have 
been recorded in the CD-ROM 44 are reproduced in the 
sound control part 30. while a player is requested to op- 
erate the controller 52 in conformity with procedures set 



to the BGM. Sound effects in response to operations 
from the player are mixed with the BGM, and outputted 
from the speaker 33. 

[0051] The data of BGM are recorded in the CD-ROM 
s 44 in the format of, for instance, CD-DA or CD-ROM XA. 
Under the formats, each piece of music is divided into 
an appropriate volume ol data to be recorded. Each of 
the divided data includes information indicative of play 
time (for example, time information of channel Q on the 
to CD standard) for each divided data, this time being de- 
fined from the top of each piece of music set as a refer- 
ence. Making use of information indicating the play time, 
the game system shown in Fig. 1 is able to specify the 
elapsed time from the beginning of a specified piece of 
is music and start to replay BGM based on data corre- 
sponding to the specified time. 
[0052] Into the CD-ROM 44, also included are score 
data defining operation procedures of the controller 52 
for each piece of BGM. Fig. 2 exemplifies score data writ- 
ten in the form of timing chart, corresponding to music 
Xas a piece of BGM recorded in the CD-ROM 44. In the 
score data, as the operating members of the controller 
52 which are to be operated in time to the music X, five 
keys A to E and one table are prepared. In forming the 
score data, for each of the keys A to E and table, deter- 
mined are that a player should operate at which position 
in the music X. The determined operating position is 
converted into an elapsed time measured from the lop 
of the music X along the time axis (corresponds to the 
lateral axis in the figure) of which reference is the top of 
the BGM. The converted time is processed into data to 
be recorded in the CD-ROM 44. The music X, which is 
BGM, is composed of a plurality of phrases, and sepa- 
rated times tl, t2, t3,... of each phrase are recorded in 
the score data in association with phrase numbers, re- 
spectively The phrase numbers are serial numbers 
placed in the order of play of the phrases, with the initial 
phrase being numbered as 1 . Moreover, the score data 
also include information specifying sound effects which 
are to be generated when each operating position is 
reached. The data of sound effects are recorded in the 
CD-ROM 44 as sound effect data, separately from both 
the BGM data and the score data, whereas information 
specifying which sound effect is used at each operated 
position in Fig.2 is recorded in the score data. 
[0053] The score data which have been recorded in 
the CD-ROM 44 are, as needed, read into the main 
memory 1 3 to be used in the game. However, in an edit 
mode later described, score data input by a player are 
written in a specified area of the main memory 13, and 
handled in the same way as the score data previously 
recorded in the CD-ROM 44. 
[0054] Fig. 3 shows a basic game picture of a music 
play game executed in accordance with the programs 
stored in the CD-ROM 44. A game piclure 100 provides 
a pair of indicators 101 A and 1 01 B for instructing to play- 
ers the operation timing of the controller 52 and a main 
display area 110 located between the indicators. Such 
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pair of indicators 1 01 A and 1 01 B are prepared for a sit- 
uation in which two players use separate controllers 52 
to play concurrently with each other. Even in this case, 
it is possible to show operation timing to each player in- 
dependently. When a single player plays ; either of the 
indicators is used solely. For example, in the case of Fig. 
2, the left indicator 101 A is used alone, while the right 
indicator 101 B is unused. Since the right and left indi- 
cators 101 A and 101 Bare identical in the configuration, 
a reference number 101 is used representatively to 
show -the indicator whenever it is unnecessary to distin- 
guish the both indicators from each other. 
[0055] As detailed in Fig.4, the indicator 101 has six 
Iracks 102A to 102F extending in the up and down di- 
rection. Of these, the tracks 102B and 102D are placed 
on lines partitioning the tracks 102A : 102C and 102E. 
[0056] Each of the tracks 102A to 102F is made to 
correspond to different operating members on the con- 
troller 52. By way of example, the track 102A is made 
to correspond to an operating member of the perform- 
ance operating portion 52a, the tracks 102C, 102E and 
102F to mutually different push button switches of the 
selection operating portion 52b : and the tracks 102B 
and 102D to mutually different push button switches of 
the selection operating portion 52c, respectively. The 
track 102F is dedicated to operations of a scratch play, 
that is, a play by which a phonograph record on the turn- 
table of an analog player is turned by the hand to be 
scratched against a needle, producing peculiar sound 
effects. Thus, it is preferred that an operating member 
made to correspond to the track 102F reminds a player 
of turn operations of the phonograph record. For in-, 
stance, a joystick-like operating member rotatable 360 
degrees by hand may be added to the controller 52 
shown in Fig. 1 , and the added member can be made to 
correspond to the track 102F. 
[0057] In Fig. 2, the keys A to E of the score data are 
made to correspond to the tracks 102A to 1 02E one by 
one, and the table F is made to be correspond to the 
track 102F. The correspondence relationship between 
the keys A to E and the tracks 102A to 102E may be 
changeable. 

[0058] Timing marks 104 104 are displayed in the 
tracks 102A to 102F on the basis of the score data 
shown in Fig.2 in order to instruct the player operation 
timing for the operating members of the controller 52 
which are made to correspond to the tracks. Specifically, 
when in performing a game, the CPU 11 reads a certain 
range of data, which are mapped in a range going for- 
ward from the current time (that is, an elapsed time from 
the start of a play) to a certain coming time : from the 
score data in Fig.2 as data of a display range in the in- 
dicator 101. The timing marks 104 are displayed at po- 
sitions on the tracks 1 02A to 1 02F corresponding to op- 
erational timings included in the display range, with both 
the time axis of the score data and the upper and lower 
axes of the indicator 101 made to correspond to each 
other so that the start point of the display range, that is, 



the current time comes to the positions of lower-end cur- 
sors 105 and 105 of the indicator 101 and the end of the 
display range comes to the upper ends of the indicator 
101. Furthermore, in the case that the score data include 
5 the separations of the phrases, the CPU 101 works to 
display on the indictor 101 separation lines 107 showing 
the phrase separations. 

[0059] When the CPU 11 repeats the foregoing 
processing at properly given intervals, the timing marks 
104 are gradually moved downward on the tracks 102A 
to 102F, as shown by an arrow F in Fig.4 (refer to a two- 
dotted line displayed on the track 102E). Where one tim- 
ing mark 104 reaches an operational position shown by 
the lower cursor 1 05 of each of the tracks 1 02A to 1 02F, 
operational timing has come to each of the operational 
members of the controller 52 corresponding to the 
tracks 102A to 102F. When a player operates a given 
operating member at this timing, a proper sound effect 
is mixed with a piece of the BGM. Data for the sound 
effects are recorded in the CD-ROM 44 in advance. Da- 
ta expressing the relationship between the operations 
to the controller 52 and the sound effects generated re- 
sponsively to the operations are also recorded in the 
CD-ROM 44. These data are loaded into the main mem- 
ory 13, as desired. 

[0060] Fig. 6 exemplifies a table formed in the main 
memory 1 3 based on data memorized in the CD-ROM 
44, in the case that sound effects are changed phrase 
by phrase. According to the table, the sound effects to 
be generated every phrase are assigned to the keys A 
to E and the table F, respectively. 
[0061] Displayed at the lower ends of the tracks 102 A, 
102C and 102E are icons 106 A, 106C and 106E that 
imitate white keys of a keyboard instrument, and dis- 
played at the lower ends of the tracks 102B and 102D 
are icons 106B and 106D imitating its black keys. 
[0062] Fig. 5 is a flowchart showing a main routine ex- 
ecuted by the CPU 1 1 for performing music play games 
based on the programs written in the CD-ROM 44. Of 
the programs and data recorded in the CD-ROM 44, 
their necessary parts are loaded in the main memory 
13. When this loading has been done, the CPU 11 ini- 
tializes various parameters on the loaded programs 
(Fig. 5, step S1 ), and displays a specified title picture on 
the monitor 25 (step S2). Commands selectable by the 
player are represented in the title picture in a menu for- 
mat. The selectable commands include a designation of 
an arcade mode in which a game is played on the data 
recorded in the CD-ROM 44 and another designation of 
a mode in which a game is played on data recorded in 
an append CD-ROM disk different from the foregoing 
CD-ROM disk 44. The pieces of music and score data 
corresponding thereto recorded in the append disk are 
different from those recorded in the CD-ROM 44. In the 
CD-ROM 44, the programs for controlling the game are 
recorded, while no such data are recorded in the append 
disk. The append disk can, therefore, serve as a storage 
medium storing the BGM data and the score data that 
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cannot be recorded due to limitation in the capacity of 
the CD-ROM 44. 

[0063] At the next step S3, a player's operation to the 
controller 52 is received, then whether or not the player 
specifies a game mode based on the append disk is de- 
termined (step S4). When such game mode is specified, 
the CPU 11 requests the changes of disks for the player 
via display on the monitor 25 (step S5), and determines 
if the disk has been changed or not : using a signal from 
the disk reading part 40 (step S6). If the disk change has 
been done, the processing proceeds to step S7. When 
it is determined at step S4 that the append disk is not 
requested, the processing is routed to step S7, skipping 
steps S5 and S6. 

[0064] At step S7, a mode selection picture is dis- 
played on the monitor 25. The mode selection picture, 
which shows modes selectable by the player : and one 
of a "game mode", "training mode", "free mode", and 
"edit mode" are selectable at this time. 
[0065] At the next step SB, it is determined whether 
the player has selected any mode through the controller 
52. If the determination is affirmative, that is, one of the 
modes has been selected, the processing advances to 
one of steps corresponding to the selected mode (step 
S10, S11, Sl2orSl3). After completing the processing 
of the selected mode, the processing is returned to step 
S2. 

[0066] The game mode of step S11 handles a mode 
for playing ordinary music play games. Specifically in 
the game mode, a piece of BGM is produced from the 
speaker 33 from the disk reading part 40 through the 
sound control part 30, and the timing marks 104 are dis- 
played within the indicator 101 in association with the 
BGM (refer to Figs.3 and 4). When the player operates 
the controller 52 in association with the display of the 
marks, the sound effect corresponding to each opera- 
tion is generated with being mixed with the BGM. The 
player can therefore enjoy playing music. In the game 
mode, each player's operation during the play of the 
BGM is compared with the score data to evaluate how 
faithfully the player has operated on the score data. 
Game results are compared with using evaluated re- 
sults as a scale. 

[0067] The training mode at step S1 2 is provided for 
exercising the play in the game mode. That is : in the 
training mode, one example is that the player can exer- 
cise about only his or her weak phrases through the rep- 
etition of the play. 

[0068] In the free mode at step S13, the player can 
freely play to in accordance with the BGM, and the 
sound effects corresponding to the operation of the con- 
troller 52 are generated with being mixed with the BGM. 
[0069] The edit mode at step S1 4 is a mode for allow- 
ing the player to input score data. By making it possible 
to newly forming and editing score data, the player can 
play a variety of types of play for the same BGM, having 
fun with games. Also the player can enjoy original ar- 
rangements. 



[0070] The processing of the edit mode will now be 
explained. Fig.7 shows a picture displayed on the mon- 
itor 25 when score data are input. Like the display of the 
monitor 25 shown in Figs.3 and 4, a plurality of display 
5 tracks 1 51 A to 1 51 F are placed in the central region of 
the picture in which the time axis is set vertically. Scroll- 
ing the tracks 151 A to 1 51 F vertically allows positions 
for setting each of sound effects composing score data 
(i.e., positions at which timing marks 152 are put) to be 
10 located at desired places in the displayed picture. Such 
scroll of the tracks 1 51 A to 151 F is brought about by 
player's operations. As shown in Fig.7, explanations 
160 teaching how to operate are displayed in the right- 
side region of the tracks 1 51 A to 151 F for performing 
various types of operations. 

[0071] Like musical scores, the tracks 151 A to 151 F 
are sectioned upwardly in turn by section lines dividing 
phrases, and phrase numbers 153 according to the or- 
der of the phrases are attached to each of the phrases. 
A musical time of each phrase corresponds to the ver- 
tical positions of the tracks 1 51 A to 1 51 F, so that a linear 
relationship between the positions and time instants is 
sustained for display. For instance, when one phrase is 
formed of four beats, a section line 1 54 at the head (low- 
er end) of each phrase corresponds to the top of the first 
beat, another position 1/4-length apart from the lower 
end of each phrase corresponds to the top of the second 
beat, another position 2/4-length apart from the lower 
end of each phrase corresponds to the top of the third 
beat, and another position 3/4-length apart from the low- 
er end of each phrase corresponds to the top of the 
fourth beat, respectively. The tracks 151 A to 151 F are 
corresponds to the operating members of the operating 
portions 52a to 52c, respectively. 
[0072] An instruction marking 155 traversing the 
tracks 151 A to 151 F is displayed on the monitor 25. By 
scrolling the tracks 151 A to 151 F to move their desired 
portions at the position of instruction marking 1 55, and 
then operating the operating members of the operating 
portions 52a to 52c, a player can assign the sound effect 
at the position of the instruction marking 155 or delete 
it. A timing mark 152 is displayed at a position at which 
the sound effect is assigned. Repeating such operation 
permits the player to input arbitrary score data. 
[0073] The score data produced by input or deletion 
in the edit mode are memorized into a specified region 
of the main memory 1 3, and the score data can be uti- 
lized in the other modes, similarly to the score data re- 
corded in the CD-ROM 44 in advance. In the game 
mode (step S11) and training mode (step S12), the op- 
erating members of the operating portions 52a to 52c 
operated to input the score data are designated as the 
operating members to be operated during the play. 
Namely, the operating members of the operating por- 
tions 52a to 52c that have been operated to assign the 
sound effect at desired timing when in inputting the 
score data are to be used as the operating members 
that should be operated for generating the sound effects 
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during the play. 

[0074] Referring to Figs. 7 to 1 5, the processing in the 
edit mode will now be explained. In the following 
processing, there are p rovided a variety of steps to allow 
the player to select desired items : determine them, or 
give any instructions: and information about operations 
such as the selection are given to the CPU 11 in an in- 
teractive manner such that the player operates the con- 
troller 52 with reference to pictures displayed on the 
monitor 25, which is a similar way to ordinary game sys- 
tems. Thus, explanations of the ways of individual op- 
erations are omitted. 

[0075] Fig, 8 shows a main routine of the processing 
in the edit mode. At step S21 in Fig.8, a display appears 
on the monitor 25, which makes the player select either 
one of editing to alter the existing score data or forming 
a new score data, and the CPU 11 determines whether 
or not there is a selection for editing. It it is determined 
that editing has been selected at step S21 , the process- 
ing proceeds to step S29, whereas the opposite deter- 
mination thereat, that is, no selection of editing, forces 
the processing to proceed to step S22. At step S22, 
whether a new formation of the score data is selected 
or not is determined, and the determination that a new 
formation of the score data has been selected makes 
the processing go to step S25, but the opposite deter- 
mination (no selection for the new score data formation) 
leads the processing to step S21. 
[0076] In the case of selection for newly forming score 
data at step S22, the processing of the BGM selection 
is performed at step S25, and then the processing of the 
new formation of the score data is performed at the next 
step S26. At step S27, the processing of preservation 
of the input score data is performed and then the 
processing goes to step S28A. The processing of the 
BGM selection, the new formation, and the preservation 
will be described later. At step S28A, display to allow the 
player to select either the continuation of inputting score 
data or the end of it are provided on the monitor 25. Ac- 
cordingly, it is determined whether the input continuation 
of the score data has been selected or not. When the 
input continuation is determined at step S25A, the 
processing returns to step S26; on the other hand, when 
no input continuation is determined, the processing pro- 
ceeds to step S28B. At step S28B.. it is determined 
whether or not the termination of inputting score data is 
selected. The determination that the input termination 
has been selected forces the processing to return to the 
main routine, while the opposite determination that the 
input termination has not been selected will lead the 
processing to step S28A. 

[0077] Meanwhile, if the selection of editing score da- 
ta is made at step S21, the BGM selection processing 
is performed at step S29, and then the processing goes 
lo step S29A. The BGM selection processing will be de- 
tailed later. At step S29A, written into a specified area 
of the main memory 13 are the score data recorded in 
the CD-ROM 44 or the append disk related to the piece 



of the selected BGM, and the score data that have al- 
ready been formed by the player in the edit mode. If any 
corresponding score data cannot be found, nothing will 
be written into the specified area of the main memory 1 3. 
5 [0078] At step S30, the data stored in the specified 
area of the main memory 1 3 are read to determine if or 
not the score data are written therein. The determination 
that the score data for the selected piece of the BGM 
have been stored in the main memory 13 at step S30 
io allows the processing to go to step S31, on the other 
hand, the opposite determination, i.e. , no storage of the 
score data, leads to a display to show such fact on the 
monitor 25, and then the processing returns to step S21 . 
At step S31, a waiting process is performed until the 
score data are selected by player's instructions, before 
proceeding to step S32. Therefore, in the case that there 
exist a plurality of sets of the score data (stored in the 
specified area) for the BGM selected at step S29, the 
step S31 process works to wait for a player's operation 
to select one set of the score data from a plurality of sets 
of the score data. If there are only one set of the score 
data for the selected BGM, a player's specified opera- 
tion (i.e., an operation to select this set of the score data) 
is waited at step S31 , and then the processing goes to 
step S32. 

[0079] At step S32, the edit processing of the score 
data selected al step S31 is performed, and the data 
preservation processing is continued for the edited data 
at step S33. Both the edit processing of the score data 
and the data preservation processing will be explained 
later. As the next processing : at step S34A, a display for 
making the player select either the continuation of score 
data input or the termination of the input is placed on the 
monitor 25, and it is determined whether or not the con- 
tinuation of the score data input has been selected. 
When it is found at step S34A that the selection of the 
input continuation has been determined, the processing 
returns to step S32, while, when the opposite determi- 
nation (i.e., no selection of the input continuation) is 
done, the processing proceeds to step S34B. At step 
S34B, it is determined whether or not the termination of 
the score data input has been selected or not, leading 
to either the return of the processing when the determi- 
nation is the selection of terminating input of the score 
data or the return to step S34A when the opposite de- 
termination (i.e., no selection of such termination) is re- 
alized. 

[0080] Next, referring to Fig.9, the BGM selection 
processing carried out at step S25 (refer to Fig.8) will 
now be described. By the way, with regard to the BGM 
selection processing at step S29 (referto Fig.8), the sim- 
ilar processing is performed. Fig. 1 0 represents a display 
picture on the monitor 25 in performing the BGM selec- 
tion processing. 

[0081] At step S25-1 ol Fig.9, as shown in Fig.10, a 
list display 1 80 of pieces of BGM is shown on the monitor 
25, and another display 181 instructing the player to se- 
lect the number of a desired piece of BGM by inputting 
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the music number is also shown thereon. At the next 
step S25-2, a cursor is placed on the first music. At step 
S25-3, the title of the cursor-placed music is represent- 
ed on the monitor 25, and then the processing goes to 
step S25-4. If it is determined that a player's instruction 
to change the cursor position has been outputted at step 
S25-4, the processing returns to step S25-3; on the oth- 
er hand, it is determined that such instruction has not 
been issued, the processing advances to step S25-5. 
[0082] At step S25-5, in cases where it is determined 
that the player has issued an instruction for changing to 
the append disk, the processing is made to advance to 
step S25-6 where a display requesting the disk changes 
is provided on the monitor 25. If the disk changes are 
then detected on the basis of a detection signal from the 
disk reading part 40 at step S27-7, the processing ad- 
vances to step S25-8. In contrast, if the determination 
that the instruction for changing to the append disk has 
not been issued from the player is produced at step 

525- 5, the processing skips to step S25-8. 

[0083] When the fact that the player has performed a 
specified operation to decide the BGM is detected at 
step S25-8, the cursor-placed music is selected as the 
piece of the BGM, and then the processing returns to 
step S26 (refer to Fig.8). However, if it is determined that 
such operation has not been done, the processing pro- 
ceeds to step S25-4. 

[0084] Concerning whether the append disk is to be 
used or not, a chance of selecting the append disk is 
also given in the processing shown in Fig. 5. Therefore, 
the processing of steps S25-5 to S25-7 may be omitted. 
[0085] Referring to Fig.1 1 , the processing of the new 
formation of the score data at step S26 (see Fig.8) will 
now be described. In this processing, score data of con- 
cerning all sound effects for a single piece of music are 
newly input. 

[0086] At step S26-1 of Fig.11, data of BGM of which 
number is selected with the foregoing BGM selection 
processing (step S25) are read and the display shown 
in Fig.7 is provided on the monitor 25. It is then deter- 
mined at step S26-2 whether or not a scroll operation of 
the display tracks 151A to 151 F has been performed, 
and the processing advances to step S26-3 if it is deter- 
mined that such scroll operation has been performed, 
but advances to step S26-5 if it is determined that such 
scroll operation has not been performed yet. At step 

526- 3, the tracks 151 A to 151 F are scrolled upward or 
downward on the monitor 25 according to operations de- 
tected at step S26-2. 

[0087] At step S26-5, it is determined whether or not 
an operation for replay has been performed. As a result, 
the determination that the relay operation has been per- 
formed allows the processing to advance to step S26-7, 
while the determination (i.e., no replay operation) oppo- 
site to the above allows it to advance to step S26-11. 
The replay operation is an operation to be performed 
when the player desires to replay the piece of music dur- 
ing the course of inputting or deleting the score data by 



the player or after completing the input or deletion op- 
eration. According to the replay operation the sound ef- 
fects on the input score data are outputted from the 
speaker 33 with being mixed with the BGM. This allows 
5 the player to confirm how the piece of music currently 
subjected to be input is actually played. 
[0088] At step S26-7, the sound effects on the input 
score data are outputted from the speaker 33 with being 
mixed with the BGM. At the next step S26-8, it is deter- 
mined whether a replay stop operation has been per- 
formed or not, and then the processing advances to step 
S26-9 if the determination that the replay stop operation 
has been performed is produced, or advances to step 
S26-10 if the opposite determination is produced (i.e., 
no replay stop). This replay stop operation is an opera- 
tion to be performed by the player when he or she wants 
to stop halfway the replay of the music. At step S26-9, 
the music is stopped, and the processing advances to 
step S26-11. At step S26-10, it is determined whether 
or not the replay of a single piece of music has been 
completed in its entirety. As a result, the determination 
is that such replay has been completed makes the 
processing go to step S26-11 , while the opposite deter- 
mination, that is, no completion of such replay, makes it 
return to step S26-7. 

[0089] By the way, a range to be replayed may be 
specified according to a player's operation. To realize 
this, one example is such that the player can specify 
start and end positions for replay. In this case, to clarify 
the range to be replayed, it is preferred to put marks or 
any other similar objects showing the start and end po- 
sitions at corresponding positions on the tracks 1 51 A to 
151 F shown in Fig.7 : for example. 
[0090] At step S26-1 1 . it is determined whether or not 
the player has performed an operation for the input ter- 
mination. The determination that such operation has 
been performed allows the processing to return to the 
main routine, while the determination opposite to the 
above (i.e., no operation) allows it to advance to step 
S26-12. This input terminating operation is used for ter- 
minating the new formation of score data. 
[0091] At step S26-1 2, it is determined whether or not 
any operating member of the operating portions 52a to 
52c has been operated. The determination that such op- 
eration has been performed allows the processing to go 
to step S26-13 : but the determination that such opera- 
tion has not been operated makes the processing return 
to step S26-2. At step S26-13, it is determined whether 
or not the timing mark 1 52 is displayed at an intersection 
made by any track 151 A (to 1 51 F) and the instruction 
marking 155. When the determination that such display 
has been done, the processing is allowed to advance to 
step S26-18, while when the determination is found to 
be no such display, the processing is made to advance 
to step S26-14. One example determined at step 
S26-1 3 can be shown by Fig.7, in which it is determined 
that the timing mark 152 is displayed at the intersection 
made by the track 1 51 C and the instruction marking 1 55, 
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but the mark 152 is not displayed at the intersections 
made by the other tracks and the mark 155. 
[0092] At step S26-14, the timing mark 152 is dis- 
played at a position pointed by the instruction making 
155 in any track 151 A (to 151 F) corresponding to any 
operating member of the operating portions 52a to 52c 
which has been determined as operated (refer to Fig.7). 
Another process is also executed at step 26-14, which 
is such that both timing information instructed by the in- 
struction marking 155 and information about an operat- 
ing member determined as operated at step S26-12 are 
written into a temporary memory incorporated within the 
main memory 1 3. In the main memory 1 3, the temporary 
memory is allocated in a different area from an area into 
which the score data are finally stored and used for tem- 
porarily memorizing input score data. 
[0093] As shown in Fig.7 ! in the picture on the monitor 
25, display regions 1 58A to 1 58F each corresponding 
to the tracks 151 A to 151 F are provided and the type of 
sound effects assigned to the timing mark 152 pointed 
by Ihe instruction marking 155 is shown in any of the 
display region 158 A to 158F each corresponding to the 
tracks. Fig.7 shows that the sound effects of which type 
is expressed as "SE 1 5" are assigned to the timing mark 
1 52 of the track 1 51 C pointed by the instruction marking 
155. 

[0094] As the next process, the sound effect selection 
processing is executed at step S26-15. In this process- 
ing, the type of sound effects to be assigned to the timing 
mark 152 is selected, which will be detailed later. At the 
next step S26-16, information about the type of sound 
effects selected at step S26-15 is written into the tem- 
porary memory with the being associated with the pre- 
viously written timing and operating member. This way 
of processing enables the player to arrange desired 
sound effects at desired timings. 
[0095] On the other hand, at step S26-18, the timing 
mark 152 is deleted, which have existed at the position 
pointed by the instruction marking 1 55 in any track 1 51 A 
(to 151 F) correlated with any operating member of the 
operating portions 52a to 52c determined as being op- 
erated. In addition, the data of the sound effects corre- 
sponding to the deleted timing mark 152 are also delet- 
ed from the score data in the temporary memory. It is 
possible for the player to delete any sound effects when 
determined as being unnecessary. 
[0096] Referring to Fig. 1 2, the sound effect selection 
processing shown at step S26-15 in Fig. 11 will now be 
described. By this processing, the type of sound effects 
correlated to the timing mark 152 displayed at step 
S26-14 in Fig. 11 is selected. As shown in Fig.7, on the 
monitor 25, the types of sound effects are displayed in 
a list using a group of numbers, 156, consisting of "SE1 " 
to "SE20 U , and a cursor 1 57 is attached to one number 
("SE15" in the case of Fig.7). The player can move the 
cursor 1 57 to any number to decide it, thereby selecting 
desired sound effects. 

[0097] At step S26A of Fig.12, the cursor 157 is set 



to the first sound effect "SE01 ' , and the processing pro- 
ceeds to step S26B. At step S26B, the cursor-set sound 
effects are displayed in the corresponding display re- 
gion 158A (to 158F) and the sound effect is replayed 
5 through the speaker 33. Accordingly, the player can con- 
firm what sound is actually generated from the cursor- 
set sound effect. At step S26C, it is then determined 
whether or not there is an operation for moving the cur- 
sor 157. If the determination is that there is such oper- 
ation, the cursor 157 is moved according to the opera- 
tion (step S26F), and then the processing returns to step 
S26B. In contrast: if the determination is no operation, 
the processing proceeds to step S26D, in which whether 
or not there isa deciding operation is determined. If such 
deciding operation has been done, the sound effect cor- 
relating to the cursor-set number is selected, and then 
the processing proceeds to step S26E, while if there has 
been no such operation, the processing returns to step 
S26C. At step S26E, the sound effect selected with the 
deciding operation is replayed and outputted from the 
speaker 33, and then the processing returns to step 

526- 16 of Fig. 1 1 . Hence, the player can confirm what 
sound is actually generated from the decided sound ef- 
fect. 

[0098] With reference to Fig. 1 3 : the data preservation 
processing at step S27 of Fig.8 will now be explained. 
This processing is executed to write into the main mem- 
ory 13 the score data input through the score data new 
formation (step S26) and stored in the temporally mem- 
ory. Owing to th e fact that the data preservation process- 
ing at step S32 of Fig.8 is similar to that processed at 
step S27, its explanation is omitted. 
[0099] At step S27-1, an instruction to let the player 
select either preservation or no preservation of the data 
is displayed on the monitor 25. At the next step S27-2, 
it is determined whether or not a specified operation to 
cancel the preservation has been done; if such cancel- 
lation has been operated, the processing returns to the 
main routine, while if such cancellation has not been op- 
erated, the processing proceeds to step S27-3. At step 

527- 3, it is determined whether or not a specified oper- 
ation for preservation has been performed. When the 
determination is affirmative (i.e., such operation has 
been done) : the processing goes to step S27-4, while 
when it is negative (i.e., no such operation), the process- 
ing returns to step S27-2. Then at step S27-4, it is de- 
termined whether or not a specified operation to com- 
mand the overwriting of the score data has been done, 
and then the processing proceeds to step S27-7 if the 
determination is that such operation has been done. At 
step S27-7, the score data memorized in the temporary 
memory is overwritten on the score data recorded in the 
main memory 1 3 in association with the music being an 
objective for which the score data are to be input, and 
then the processing returns to the main routine. By this 
process, the original score data which has been record- 
ed are replaced by the new score data. However, if no 
score data concerning the music has been recorded in 
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Ihe main memory 13, the score data which have been 
memorized in the temporary memory are written in a 
predetermined area of the main memory 1 3 assigned to 
the music. 

[0100] On the other hand, when it is determined that 
the specified operation to command the overwriting of 
the score data has not been performed, the processing 
proceeds to step S27-5. At step S27-5, it is determine 
whether or not a specified operation to command new 
preservation of the score data has been done, and then 
the processing proceeds to step S27-6 if the determina- 
tion is that such operation has been performed. At step 
S27-6, a new storage area is allocated in the main mem- 
ory 13, the score data memorized in the temporary 
memory are written in this area, and then the processing 
returns to the main routine. 

[0101] With reference to F ig. 1 4, the score data editing 
processing shown at step S32 will now be described. In 
this processing, the score data recorded in the CD-ROM 
44 or the main memory 13 are written in the temporary 
memory, and corrected by the player to allow the player 
to input new score data. Correcting already-made score 
data leads to an efficient input operation of the score 
data. 

[0102] At step S32-1 of Fig. 14, the data of the BGM 
of which number was selected by the foregoing BGM 
selection processing (Step S25) are read. Then at step 
S32-2, the score data selected at step S31 are read from 
the CD-ROM 44 or the main memory 1 3, a display pic- 
ture such as shown in Fig.7 is provided from the monitor 
25, and then the processing goes to step S32-3. The 
score data read from the CD-ROM 44 are data prepared 
and recorded in advance, as described above; on the 
other hand, the score data read from the main memory 
1 3 are the score data input through the foregoing score- 
data new-forming processing or the score data edit 
processing and written into the main memory 1 3 through 
the data preservation processing at step S27 or S33. 
That is, the score data prepared and recorded in the CD- 
ROM 44 or the append disk in advance can be corrected 
to the new score data, while the score data formed by 
the player can also be corrected. 
[0103] Step S32-3 and succeeding steps thereto are 
processed in a similar way to step S26-2 and succeed- 
ing steps thereto for the score-data new-formation 
processing explained in Fig.11, so that detailed expla- 
nation of those steps is omitted here. Like the score- 
data new-formation processing, the score data newly 
corrected and formed can be replayed to be confirmed 
(step S32-5 to -1 0), and the formed score data are writ- 
ten in the temporary memory (steps S32- 1 2 to -1 6). Also 
the score data loaded in the temporary memory can be 
deleted (step S32-18). 

[0104] Fig. 16 shows one modification of the control- 
ler. A controller 200 has, as operating members for car- 
rying out performance operations during a game, five 
push button switches 201 A to 201 E arranged similarly 
to the icons 106A to 106 E on the lower end of the indi- 



cator 101 , and a disk-like operating member 201 F ar- 
ranged at the right side thereof. The operating member 
201 F can be operated to turn about its central portion. 
Pushing the operating members 201 A to 201 E enables 
5 signals corresponding to operations to be outputted, 
while turning the operating member 201 F enables sig- 
nals corresponding to be outputted, such as signals cor- 
relating to its turn direction and the amount of its rota- 
tion. On the upper part of the controller 200, a selection 
button 202 and a start button 203 are placed, both of 
which are formed into a push button type of switch and 
used for selection of games or other performances. 
[0105] This controller 200 has the advantage that the 
correspondent relationship between the tracks 102 A to 
102F of the indicator 101 and the operating members 
201 A to 201 F are clarified, an operational performance 
for games being improved. 

[0106] Figs. 17 and 18 represent displays on the mon- 
itor 25 in cases where the controller 200 is used instead 
of the foregoing controller 52. Of these, Fig. 17 replaces 
Fig. 10 and Fig. 18 does Fig.7. In Figs. 17 and 18, identi- 
cal displays to Figs. 10 and 7 are represented by the 
same references. 

[0107] By the way, in the score-data new-formation 
processing or score data edit processing, though the 
types of sound effects are made to correspond to the 
operating members every time when each sound effect 
is assigned, the sound effect may be assigned to the 
operating members of the operating portions 52a to 52b 
in advance. This simplifies the input operation of the 
score data. Further, in this case, it may be possible to 
change the assignment of the sound effects to the op- 
erating members with interruption processing. 



[01 08] A second embodiment of the present invention 
will now be described. 

[01 09] In this embodiment, score-data new-formation 

40 processing shown in F ig. 1 5 is performed in place of that 
at step S26. In the processing of Fig. 15, Ihe operating 
members can be operated freely by the player to the 
BGM under replay, resulting in that score data correlat- 
ing to the operations are input. Thus, the player can per- 

4$ form an actual play as he or her hears the BGM, result- 
ing in that score data corresponding to the play can be 
formed. In consequence, it is possible to directly input, 
as score data, information about plays imaged by the 
player into the system. 

so [0110] With reference to Fig. 1 5, the score-data new- 
formation processing will now be explained. At step S41 
in Fig. 1 5, the data of the BGM whose number is selected 
by the BGM selection processing (step S25) are read. 
At step S42, the processing waits for a specified oper- 

55 ation for commencing the replay of the BGM, and then 
processing proceeds to step S43. At step S43, replaying 
the selected BGM starts, and then the processing goes 
to step S44. At step S44, it is determined whether or not 
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the operating members are operated, and then the 
processing goes to step S47 when determined as being 
operated. At step S47 : information about both the oper- 
ated timing and the names of operated operating mem- 
bers are stored in the temporary memory, and then the s 
processing returns to step S44. Also at step S47, the 
sounds corresponding to the operations to the operating 
members are outputted with being mixed with the BGM. 
In other words, depending on player's operations per- 
formed to the operating members, sound effects mixed 10 
with the BGM are outputted from the speaker 33. In this 
case, the types of sound effects are appropriately se- 
lectable from a table previously set in the main memory 
13. Furthermore, the types of sound effects memorized 
as score data may be input prior to the replay of the BGM 1& 
in response to specified player's operations. 
[0111] When it is determined at step S44 that operat- 
ing members have not been operated yet, it is also de- 
termined whether or not the replay of the BGM has end- 
ed at step S45. As a result, when determined as being ?o 
the end of the replay, the processing stops the replay at 
step S46, and then the processing returns to its main 
routine, while when the replay is determined as not be- 
ing ended, the processing returns to step S44. 
[0112] In the game mode (step S11) and the training 25 
mode (step S12), the operating members that were op- 
erated in inputting score data are assigned to as the op- 
erating members to be operated during the replay. 
Namely, the operating members that were operated for 
arranging sound effects at given timings in the input op- 30 
eration of the score data provide the operating members 
which should be operated for generating the sound ef- 
fects during the play. 

[01 13] In this way, information about both the operat- 
ing members which has been operated and their oper- 35 
ated timings are recorded as the score data in the tem- 
porary memory. In addition, it may be possible that the 
tracks shown in Fig.7 are scroll-displayed to the replay 
ol the BGM and the timing marks are put on the tracks 
in sequence in association with the operations toward 40 
operating members. 

[0114] Therefore, the above embodiments have vari- 
ous features providing a variety of features of the 
present invention. 

[0115] One such feature is provided as follows. Owing 
to the fact that there is provided a data inputting device 
for inputting or deleting at least part of data defining the 
performance procedures in response to an operation 
performed by a player, and a performance operation in- 
structing device for instructing the player to perform pre- so 
determined performance operations based on the data 
input through the data inputting device, the player can 
form the data by him or herself , and can enjoy the game 
more actively. 

[0116] Sine the game system comprises a data edit- ss 
ing device for editing data defining the performance pro- 
cedures according to an operation of the player, and a 
performance operation instructing device for instructing 



predetermined performance operations based on the 
data edited by the data editing device, the player can 
form the data at will and have a greater feeling of satis- 
faction in the game. 

[0117] The system comprises a data forming device 
for newly forming data defining the performance proce- 
dures according to an operation of the player, and a per- 
formance operation instructing device for instructing the 
player to do predetermined performance operations 
based on the data newly formed through the data form- 
ing device. Therefore, the player can form the data at 
will and enjoy the game with an exciting feeling. 
[0118] Predetermined performance operations can 
be taught the player based on the data input responsive- 
ly to the player's operation, resulting in that the player 
can form the data at will and have a positive attitude in 
pursuing fan at the game. 

[0119] It is possible to teach the player predetermined 
performance operations based on the data edited in re- 
sponse to the player's operations. This allows the player 
to form the data by him or herself and to have more fun 
at the game. 

[01 20] It is also possible to give the player instructions 
about predetermined performance operations based on 
the data newly formed in response to the player's oper- 
ations: thereby allowing the player to form the data at 
will and enjoy the game more satisfactorily. 
[0121] Although the description above contains many 
specificities, these should not be construed as limiting 
the scope of the invention but as merely providing illus- 
trations of some of the presently preferred embodiments 
of this invention. Thus the scope of this invention should 
be determined by the appended claims and their equiv- 
alents. 



Claims 

1 . A game system comprising: 

a data storage device for respectively memo- 
rizing data for replaying music and data defin- 
ing performance procedures for the music; 
a performance operating device lor receiving 
performance operations of a player; 
a music replaying device for replaying the mu- 
sic based on the data for replaying the music; 
a performance operation instructing device lor 
instructing the player to do performance oper- 
ations associated with the replay of the music 
to the performance operating device based on 
the data defining the performance procedures; 
a performance effect generating device for gen- 
erating performance effects corresponding to 
the performance operations to the performance 
operating device; and 

a data inputting device for inputting or deleting 
at least part of the data defining the perform- 



13 



25 



EP0 993 847 A1 



26 



ance procedures in response to operations of 
the player, 

wherein the data formed through the data in- 
putting device are stored into the data storage 
device and the performance operation instruct- 
ing device can instruct the player to do prede- 
termined performance operations based on the 
data input through the data inputting device. 

2. The game system according to claim 1, further com- 
prising a device for storing a plurality of types of 
sound effects to be generated as the performance 
effects. 

3. The game system according to claim 2, whe rein one 
type of the sound effects to be generated as the per- 
formance effects can be selected in accordance 
with an operation of the player when the data defin- 
ing the performance procedures are input through 
the data inputting device. 

4. The game system according to claim 3, wherein a 
selected sound effect can be replayed when said 
one type of the sound effects is selected in accord- 
ance with the operation of the player. 

5. The game system according to any one of claims 1 
to 4, further comprising an indicating device for 
showing a position residing in the music to be sub- 
jected to input or deletion of the data, when the data 
defining the performance procedures are input or 
deleted in a piece of the music by the player through 
the data inputting device. 

6. The game system according to any one of claims 1 
to 5, further comprising a replaying device for re- 
playing the sound effects based on the data defining 
the performance procedures when the data defining 
the performance procedures are input or deleted 
through the data inputting device. 

7. The game system according to claim 6, wherein the 
replaying device can replay a series of the sound 
effects to be used as the performance effects after 
completing the operations of the player to input or 
delete the data defining the performance proce- 
dures. 

8. The game system according to claim 7, wherein the 
replaying device can replay the sound effects with 
mixing the music. 

9. The game system according to claim 7 or 8, further 
comprising a range setting device for setting, in ac- 
cordance with an operation of the player, a range of 
the sound effects to be replayed through the replay- 
ing device to an extent corresponding to at least part 
of a piece of the music. 



1 0. The game system according to claim 6, wherein the 
data inputting device is constructed such that the 
data are input by making the player repeat opera- 
tions of assigning the respective sound effects cor- 

5 responding to each of the performance operations 
composing the performance procedures, and the 
replaying device can replay each of the input sound 
effects every time the player assigns the sound ef- 
fects to each of the performance operations. 

10 

11. The game system according to any one of claims 1 
to 10, wherein the data storage device memorizes 
data defining a plurality of sets of the performance 
procedures for one piece of the music. 

15 

12. The game system according to any one of claims 1 
to 11 , wherein the data memorized in the data stor- 
age device and defining the performance proce- 
dures corresponding to a specific piece of the music 

20 are all input through the data inputting device. 

13. The game system according to any one of claims 1 
to 12, wherein the performance operating device 
can be used as the data inputting device and the 

2S performance operations instructed through the per- 
formance operation instructing device are the same 
as player's operations performed in inputting the da- 
ta defining the performance procedures. 

30 1 4. The game system according to any one of claims 1 
to 13, further comprising: 

an input-position pointing device for indicating 
a position in a piece of the music at which the 
35 data are input or deleted, when the player in- 

puts or deletes the data defining the perform- 
ance procedures corresponding to the piece of 
the music through the data inputting device; 
and 

40 an indicator having at least one track extending 

in a specified direction, 

wherein the performance operation instructing 
device displays, based on the data defining the 
performance procedures, an indication mark to 
45 indicate operation timing of the performance 

operating device within the indicator in such a 
manner that the indication mark moves along 
the track and then reaches a performance op- 
eration position fixedly set at a specified loca- 
50 tion of the track when the operation timing of 

the performance operating device correspond- 
ing to the indication mark comes, and 
the input-position pointing device displays, 
within the indicator, a pointing mark to show a 
55 position existing in the music at which the data 

are input or deleted in such a manner that the 
pointing mark moves along the track and is lo- 
cated at an input-operation position fixedly set 
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at a specified location of the track when the da- 
ta inputting device is operated correspondingly 
to the pointing mark. 

15. A game system comprising: 



a performance effect generating device for gen- 
erating performance effects according to the 
performance operations to the performance op- 
erating device; and 

a data forming device for newly forming data 
defining the performance procedures accord- 
ing to operations of the player, 
wherein the data storage device memorizes the 
data newly formed and the performance oper- 
ation instructing device can instruct the player 
to do predetermined performance operations 
based on the data newly formed through the da- 
ta forming device. 



17. A computer-readable storage medium storing data 
for replaying music, data defining performance pro- 
cedures for the music, and a program for performing 
a predetermined music performing game based on 

5 both of the data, the program being formed to allow 
a computer to perform the following steps of: 

replaying the music based on the data for re- 
playing the music; 

instructing a player to do performance opera- 
tions associated with the replay of the music to 
a performance operating device based on the 
data defining the performance procedures for 
the music; 

generating performance effects corresponding 
to the performance operations to the perform- 
ance operating device; 

inputting or deleting at least part of the data de- 
fining the performance procedures and memo- 
rizing an input or deleted result data in re- 
sponse to operations of the player; and 
pointing predetermined performance opera- 
tions to the player based on the memorized da- 
ta. 

18. A computer-readable storage medium storing data 
for replaying music, data defining performance pro- 
cedures for the music, and a program for performing 
a predetermined music performance game based 
on both of the data, the program being formed to 
allow a computer to perform the following steps of: 

replaying the music based on the data for re- 
playing music; 

instructing a player to do performance opera- 
tions associated with the replay of the music to 
a performance operating device based on the 
data defining performance procedures; 
generating performance effects corresponding 
to the performance operations to the perform- 
ance operating device; 

editing the data defining performance proce- 
dures in accordance with operations of the 
player; and 

instructing predetermined performance opera- 
tions based on the edited data. 

19. A computer-readable storage medium storing data 
for replaying music, data defining performance pro- 

so ceduresfor the music, and a program for performing 
a predetermined music performance game based 
on both of the data, the program being formed to 
allow a computer to perform the following steps of: 

55 replaying the music based on the data lor re- 

playing the music; 

instructing a player to do performance opera- 
tions associated with the replay of the music to 



a data storage device for respectively memo- 
rizing data for replaying music and data defin- 
ing performance procedures for the music; 
a performance operating device for receiving io 
performance operations of a player; 
a music replaying device for replaying the mu- 
sic based on the data for replaying the music; 
a performance operation instructing device for 
instructing the player to do performance oper- is 
ations associated with the replay of the music 
to the performance operating device based on 
the data defining the performance procedures; 
a performance effect generating device for gen- 
erating performance effects corresponding to 20 
the performance operations to the performance 
operating device; and 

a data editing device for editing data defining 
the performance procedures memorized in the 
data storage device in response to operations 25 
of the player 

wherein the performance operation instructing 
device can instruct predetermined perform- 
ance operations based on the data edited 
through the data editing device. 30 

16. A game system comprising: 

a data storage device for respectively memo- 
rizing data for replaying music and data defin- 35 
ing performance procedures for the music; 
a performance operating device for receiving 
performance operations of a player; 
a music replaying device for replaying the mu- 
sic based on the data for replaying the music; *o 
a performance operation instructing device for 
instructing the player to do performance oper- 
ations associated with the replay of the music 
to the performance operating device based on 
the data defining the performance procedures; 45 
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a performance operating device based on the 
data defining the performance procedures; 
generating performance effects corresponding 
to the performance operations to the perform- 
ance operating device; 5 
newly forming the data defining the perform- 
ance procedures in response to operations of 
the player; 

memorizing the newly formed data; and 
instructing the player to do predetermined per- io 
formance operations based on the memorized 
data. 



15 



20 



25 



30 



35 



40 



45 



50 



16 



EP 0 993 847 A1 



FIG. 1 



10 



12- 



13- 



14- 



1 1 



PERIPHERAL 
DEV I CE 



CPU 



GTE 



21 



20 



MAIN 
MEMORY 



i 
i 
I 
I 

Ax 



ROM & 



24 



MDEC 



GPU 



=KVIDE0 OUTPUT 



22 



25 



FRAME 
BUFFER 



23 



SPU 



Lz: 



32 



SOUND 
BUFFER 



z-31 33 

hp 

SOUND OUTPUT 



30 



61 



62- 



PARALLEL 

I/O 



CD-ROM M 1 
DECODER h— O - 44 

"^~42 CD-ROM DISK 



SERIAL 
I/O 



CD-ROM 
BUFFER 



43 



40 



52c ! 



jC 



51 



COMMUNICATION 
CONTROL DEV I CE h-i 




MAIN 
BUS B 



50 



MEM 



52bi 
CONTROLLER 



ORY 



CARD 



53 



17 



EP 0 993 847 A1 



FIG. 2 



PHRASE 

V 





\ 






MUSIC X 




PHRASE 2 


PHRASE 3 



KEY A 



KEY B 



KEY C 



KEY D 



KEY E 



TABLE 



ON 
OFF 

ON 
OFF 

ON 
OFF 

ON 
OFF 

ON 
OFF 

ON 
OFF 



1 1 

t 



POST I ON 
TO BE OPERATED 
OPERATION^ 
IMING / 



(OP, 



t2 



DISPLAY RANGE 



t3 



PLAY TIME 



PLAY START POST I ON 



18 



EP 0 993 847 A1 




EP 0 993 847 A1 

FIG. 4 



102B 102D 




106C 106D 106E 



20 



EP 0 993 847 A1 



FIG. 5 



( START ) 







I N I T I AL I ZAT I ON — - S 1 








DISPLAY TITLE PICTURE -^S2 



RECEIVE OPERATIC 


)N FOR SELECTION 




-^__/-S4 



APPEND DISK? 
Y 



N 



REQUEST DISK CHANGES 



S5 



N 




DISPLAY MODE SELECTION PICTURE— ~S7 




S11 



SI 2 



SI 3 



SI 4 



GAME 
MODE 




TRAINING 
MODE 




FREE 
MODE 




EDIT 
MODE 





















21 



EP 0 993 847 A1 



FIG. 6 





PHRASE 1 


PHRASE 2 


PHRASE 3 


KEY A 


SOUND EFFECT 1 


SOUND EFFECT 11 


SOUND EFFECT 1 


KEY B 


SOUND EFFECT 2 


SOUND EFFECT 12 


SOUND EFFECT 2 


KEY C 


SOUND EFFECT 3 


SOUND EFFECT 13 


SOUND EFFECT 3 


KEY D 


SOUND EFFECT 4 


SOUND EFFECT 14 


SOUND EFFECT 4 


KEY E 


SOUND EFFECT 5 


SOUND EFFECT 15 


SOUND EFFECT 5 


TABLE 


SOUND EFFECT 6 


SOUND EFFECT 16 


SOUND EFFECT 16 



22 



EP 0 993 847 A1 



o 
to 



6 

Ll 




O uj 
2 - _j 

I 00 UJ 

I O 

I UJ ^ 

or D ° 



< a: 

S \ 

O -i 

O 



O 

□ 5 

\ H 

H < 

ll a: 

uj O 

-J 00 



O 

O 
to 



CNJ 

a: 

\ 

CSJ 



Cl 






O 






H 


<« 


► 


00 








(J 


a 


o 


LU 


LU 




— J 


-J 


> 


LU 


LU 


< 


CO 


CO 


-J 






Q_ 


LU 


LU 


LU 


CO 


00 


cr 







q: 
< 

h- 
CO 



LU 

< 

CO 



(J 



LU 
CO 




in' 




TT 


OO 


CNJ 


to 


o 








O 


O 






CXI 








LU 


UJ 


UJ 


UJ 


UJ 




ID 




CO 


to 


to 


to 


OO 




LD 


















H 


CO 






LO 


CD 






O 


o 


o 


UJ 




UJ 






UJ 


LU 
GO 


LU 

to 


to 


LU 

to 


CO 






Ll 
















Ll 


CM 


to 


o 




CO 






UJ 


O 
UJ 


O 
LU 


LU 


UJ 


LU 








CO 


to 


to 


CO 


to 






O 




















i_n 


CD 


CO 








ID 


o 

LU 


o 

UJ 


O 
LU 


UJ 


UJ 






O 


CO 


GO 


to 


CO 


CO 





CO 



< 

< 




23 



EP0 993 847 A 1 
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